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Given relevant cultural distinctions across nations, it is important to determine the 
dimensional structure and normative characteristics of psychological assessment devices in 
each focal population. This article examines the national standardization and validation of the 
Adjustment Scales for Children and Adolescents (ASCA) with a nationally representative 
sample of Trinidad and Tobago schoolchildren (N = 900). ASCA is a 156-item teacher rating 
scale that measures sociobehavioral adjustment. Results from exploratory and confirmatory 
analyses yielded the same Overactivity and Underactivity dimensions observed in 
international samples. The dimensions were scaled using IRT and Bayesian scoring, with 
scores evincing expected moderate to strong relationships with other teacher observations and 
weaker relationships with parent observations and reading achievement. Population 
performance trends are explored and implications are discussed. 
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Child and adolescent socioemotional health is an inter¬ 
national concern. Worldwide, up to 20% of children and 
adolescents experience notable emotional or behavioral 
distress, with suicide as the third leading cause of adolescent 
death (World Health Organization [WHO], 2005). Although 
children with emotional and behavioral disorders are often 
first seen in the educational system (Burns et al., 1995), 
school-based personnel and services are inadequate in all 
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but a few high-income countries (WHO, 2005). Worldwide, 
it has been estimated that at least half of child mental health 
training needs are unmet (WHO, 2005). As a result, the 
majority of youth with serious disorders go unrecognized 
and untreated (Morris et al., 2011). For example, the treated 
prevalence of children and adolescents internationally is 
159 per 100,000 population compared to 664 per 100,000 
for the adult population (Morris et al., 2011). Poor social- 
emotional adjustment in youth is linked to educational 
failure, substance abuse, violence, and other health 
problems, whereas social competency is related to greater 
well-being and higher academic achievement (Eisenberg, 
Fabes, & Spinrad, 2006; Guerra & Bradshaw, 2008; Masten 
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& Coatsworth, 1998; Patel, Flisher, Hetrick, & McGorry, 
2007; Weissberg & Greenberg, 1998). 

Of course, children and adolescents with emotional and 
behavioral disorders must first be identified before they can 
be treated (United Nations Children’s Fund, 2013). 
Identification is formally accomplished through assessment 
that includes a variety of methods, including interviews, 
observations, cognitive and academic tests, and behavior 
rating scales (McConaughy & Ritter, 2014). Behavior rating 
scales have become especially important because of their 
convenience, scope of coverage, naturalistic foundation, 
efficiency, ecological validity, standardization, and norms 
(Barry, Frick, & Kamphaus, 2013; Dowdy, Twyford, & 
Sharkey, 2013; Merrell, 2008). 

Many behavior rating scales are based on the theory that 
all problem behavior can be reduced to two or more 
broadband behavioral dimensions drawn from Eysenck’s 
(1953) extraversion-introversion versus neuroticism dichot¬ 
omy (Kohn, 1977; Peterson, 1961; Rutter, 1967). Although 
variously labeled personality problems versus behavior 
problems (Peterson, 1961), overactivity versus under¬ 
activity (Stott, 1979), and undercontrolled versus over¬ 
controlled (Achenbach & Edelbrock, 1978), usage of an 
internalizing versus externalizing problems designation 
(Achenbach. 1966) has become common (Merrell, 2008). 
The internalizing dimension is characterized by problems 
with inhibited and shy-anxious behavior and is related to 
disorders such as depression, anxiety, phobias, and panic 
(Markon, 2010). In contrast, the externalizing dimension is 
distinguished by disinhibition and acting out behaviors, and 
is linked to substance abuse and dependence, antisocial 
personality disorder, and conduct disorder. 

Latent variable modeling procedures have shown that the 
two hierarchical constructs of internalizing and externaliz¬ 
ing underlie many of the common Diagnostic and Statistical 
Manuals of Mental Disorders (DSM; American Psycho¬ 
logical Association [APA], 1987) diagnoses (Wright et al., 
2013). The internalizing-externalizing (IE) model has 
proven to be robust across age, sex, ethnicity, culture, 
informant type, instrument, and DSM Axes (Achenbach, 
1966; De Clercq, De Fruyt, Van Leeuwen, & Mervielde, 
2006; Eaton, Krueger, & Oltmanns, 2011; Forbush & 
Watson, 2013; Kramer, Krueger, & Hicks, 2008; Krueger, 
Capsi, Moffitt, & Silva, 1998; Krueger, Chentsova-Dutton, 
Markon, Goldberg, & Ormel, 2003; Lahey et al., 2008; 
Rescorla et al., 2011; Slade & Watson, 2006; Slobodskaya, 
2014; van der Ende, Verhulst, & Tiemeier, 2012; Wright 
et al., 2013). In contrast, there has been variability when 
narrower dimensions of psychopathology have been 
hypothesized (Gomez & Vance, 2014; Goodman, Lamping, 
& Ploubidis, 2010; McConaughy & Ritter, 2014; Pendergast 
et ah, 2014; Van Meter et ah, 2014). 

Given the robustness of the internalizing and externaliz¬ 
ing constructs, they have been incorporated into many 
behavior rating scales (Dowdy et ah, 2013; Meirell, 2008) 


and modern models of mental health promulgated by the 
WHO (2007) promote widespread application of behavior 
rating scales (Carlson, Benson, & Oakland, 2010). 
Unfortunately, most of those behavior rating scales have 
been standardized and normed in Western industrialized 
nations and few are available in other regions of the world 
(Mpofu, Oakland, Ntinda, Seeco, & Maree, 2014). 
International surveys have found that tests are frequently 
imported from other countries without appropriate norma¬ 
tive data and absent requisite evidence of reliability and 
validity (Hu & Oakland, 1991; Oakland & Hu, 1993). These 
trends are especially prevalent outside Australia, Canada, 
Western Europe, and the United States and among 
developing countries (Oakland, 2004; Oakland, Wechsler, 
& Maree, 2013). 

Cultural differences among nations and people make it 
important to normatively standardize instruments that are 
germane to psychological assessment in each population of 
interest (United Nations Children’s Fund, 2013). It is a 
common misperception that psychometric properties (such 
as validity and reliability at the item and scale level) are 
preserved regardless of where and with whom an instrument 
is used (van Widenfelt, Treffers, de Beurs, Siebelink, & 
Koudijs, 2005). Moreover, not all items and constructs are 
universally meaningful (Hambleton & Patsula, 1998) and 
cultural norms can influence the respondent’s judgment of 
the acceptability of different types of behaviors, inter¬ 
actions, and relationships (Rubin, 1998; United Nations 
Children’s Fund, 2013). Emotional distress among children 
and adolescents appears to be universal, but the particulars 
of cultural context lead to variations of expression and 
necessitate examination of instruments for use in each 
nation (van Widenfelt et al., 2005). 

Like other developing nations, the Republic of Trinidad 
and Tobago has no nationally normed and psychometrically 
sound behavior rating scales, although its high crime rates 
(Greenberg & Agozino, 2012) as well as economic 
disparities, harsh parental disciplinary practices, and other 
social challenges (Cappa & Khan, 2011; Krishnakumar, 
Narine, Roopnarine, & Logie, 2014; Roopnarine, Krishna¬ 
kumar, Narine, Logie, & Lape, 2014; Williams, 2013) 
reflect a compelling need for assessment and intervention to 
improve child and adolescent socioemotional health. Well 
aware of those needs, Trinidad and Tobago has teamed with 
the United Nations and other global organizations to 
improve social, economic, and human conditions (United 
Nations, 2014). Education has been recognized as especially 
important and the Ministry of Education has undertaken 
efforts to identify and support children and adolescents at 
risk for academic and behavior problems (Johnstone, 2010; 
Watkins, Hall, & Worrell, 2014). Without the economic 
resources and human capital required for extensive test 
development (Oakland et al., 2013), the Ministry of 
Education elected to standardize and validate the 
Adjustment Scales for Children and Adolescents (ASCA; 
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McDermott, Stott, & Marston, 1993) in Trinidad and 
Tobago for the purpose of identifying students with 
sociobehavioral problems and determining the prevalence 
of maladjusted students (Watkins et al., 2014). 

The ASCA is comprised of 156 descriptions of behavior 
in 29 social, recreational, or learning situations in which a 
teacher observes a youth’s adjustment to authority, peers, 
other youth, and various tasks. Instead of relying on 
estimates of frequency or severity of behaviors, respondents 
identify specific behaviors with the severity of the 
behavioral disturbance determined by the pervasiveness of 
behaviors across situations. A national standardization and 
validation of ASCA was conducted in the United States with 
a norm sample of 1,400 students aged 5 through 17 years 
(McDermott, 1993; McDermott, Steinberg, & Angelo, 
2005). The sample was stratified according to the U.S. 
Census by age, gender, academic level, ethnicity, disability, 
region, community size, and parent education. Exploratory 
and confirmatory components analyses revealed six core 
syndromes and two second-order factors that are general- 
izable across age, gender, and ethnicity. Core syndromes 
include attention-deficit hyperactive, solitary aggressive 
(provocative), solitary aggressive (impulsive), oppositional 
defiant, diffident, and avoidant, while second-order factors 
are overactivity and underactivity. The overactivity and 
underactivity dimensions have been found in other 
populations including Hispanic/Latino, Native American, 
and Canadian youth (Canivez & Beran, 2009; Canivez & 
Bohan, 2006; Canivez & Sprouls, 2005, 2010). 

The purpose of this study was to examine the normative 
development, dimensionality, and validation of ASCA for 
national application in Trinidad and Tobago. It follows 
a pilot study assessing the construct validity of ASCA in 
Trinidad and Tobago (George, McDermott, Watkins, 
Worrell, & Hall, 2012). Exploratory and confirmatory 
components analyses are conducted to examine the 
dimensional structure. The prevalence of problem behaviors 
is examined at the item level and scaled scores are estimated 
using item response theory (IRT). Product-moment 
correlations are applied to determine the direction and 
magnitude of relationships between scores on each ASCA 
dimension and external criterion variable, and relationships 
are further assessed using hierarchical linear modeling. 


METHOD 

Setting 

Trinidad and Tobago is the southernmost country in the 
Caribbean chain of islands. It encompasses the twin islands 
of Trinidad and Tobago. Postcolonial and English-speaking, 
the country gained independence from Britain in 1962 
but remains a Commonwealth country. The population is 
around 1.3 million with approximately 34% of African 


ancestry, 35% of East Indian ancestry, 24% of mixed 
ancestry, and 7% other ancestry (Central Intelligence 
Agency, 2014). Education in Trinidad and Tobago is free 
and compulsory between the ages of 5 and 16 years. Order 
and discipline are the prevailing forms of parent-child 
interaction (Barrow, 2008). Rather than encouraging play, 
parents tend to expect children to assist in the home and 
often to care for siblings by the age of 5 (Barrow, 2008). 
Corporal punishment in homes is common and accepted as a 
cultural norm, where respect for authority is a universally 
emphasized value for children (Barrow, 2008; Cappa & 
Khan, 2011; Gopaul-McNicol, 1999; Roopnarine et al., 
2014). Discipline becomes more emphasized as children 
approach school age, with disobedience attributed to 
parental leniency (Barrow, 2008; Gopaul-McNicol, 1993). 

Sample and Participants 

Participants were children aged 4-15 years (M = 8, 
SD = 2) drawn from government and assisted elementary 
schools nationwide. The national normative sample 
(N = 700) was blocked to be representative by grade and 
gender, and a supplemental validity sample was drawn by 
oversampling (n = 200), for a full sample of 900. The 
sample was 50.3% female and 49.7% male, with 39.9% of 
African descent, 38.3% East Indian descent, and 21.7% 
mixed descent. 

Instruments 

Classroom sociobehavioral adjustment 

ASCA is a behaviorally based teacher rating scale 
consisting of 156 items describing positive and problem 
behavior in relation to 29 classroom situations. Classroom 
situations examples include playing fairly, getting along 
with peers, being truthful to the teacher, seeking teacher 
help, taking part in team games, and coping with new 
learning tasks. The teacher indicates a student’s observed 
behavior over the past two months by marking any 
behavioral description pertinent to a given situation. More 
than one behavior can be chosen to describe the child within 
each social, play, or learning context. For example, the 
coping with new learning tasks context includes items such 
as, “Has a happy-go-lucky attitude to every problem,” 
“Charges in without taking time to think or follow 
instructions,” “Approaches a new task with caution but 
gives it a try,” “Won’t even attempt it if she senses a 
difficulty,” “Likes the challenge of something difficult,” and 
“Cannot work up the energy to face anything new.” 

The 29 positive items (prevalence greater than or equal to 
50%) were included to reduce response bias by allowing 
teachers to identify children’s behavioral strengths. 
In previous research, teachers found it easier to respond to 
item sets that included positive behaviors (McDermott, 
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1993) . Examples of the ASCA score reliability and validity 
are documented in the instrument manual (McDermott, 

1994) , as well as in numerous studies. These include studies 
supporting the instrument’s internal consistency (Canivez, 
2004, 2006; Canivez & Bohan, 2006; McDermott, 1993, 
1994), interrater agreement (Canivez & Watkins, 2002; 
Canivez, Watkins, & Schaefer, 2002; Watkins & Canivez, 
1997), and short-term stability (Canivez, Perry, & Weller, 
2001; McDermott, 1993, 1994). There is substantial 
evidence of convergent and divergent/discriminant validity 
(Canivez & Bordenkircher, 2002; Canivez, Neitzel, & 
Martin, 2005; Canivez & Rains, 2002; McDermott, 1994; 
McDermott et al., 1995), while factorial validity in other 
populations has been demonstrated (Canivez & Beran, 
2009; Canivez & Bohan, 2006; Canivez & Sprouls, 2010; 
George et al., 2012). 

Classroom learning behavior 

The Learning Behaviors Scale (LBS; McDermott, 1999) is a 
teacher rating scale containing 29 items, including both 
negative and positive learning behaviors, and yielding both a 
total score and four subscale scores (Competence Motiv¬ 
ation, Attitude Toward Learning, Attention-Persistence, 
Strategy/Flexibility). Teachers who have observed the child 
for at least 50 days rate the manifestation of each behavior on 
a three-point Likert scale. The LBS was standardized on 
1,500 students aged 5-17 years, and blocked for age, 
gender, and grade level. The LBS was found to have a factor 
structure that is invariant across gender, age, and ethnic 
group. Studies have documented score internal consistency 
and interrater reliability (McDermott, 1999; Worrell, 
Vandiver, & Watkins, 2001), and structural validity 
(McDermott, 1999; Worrell et al., 2001). Convergent and 
divergent validity for the LBS have been documented with 
the Differential Ability Scales (Elliott, 1990), ASCA 
(McDermott et al., 1993) and three subtests from the Basic 
Achievement Skills Individual Screener (Psychological 
Corporation, 1983). 

Classroom clinical behavior 

The Disruptive Behavior Disorders Rating Scale (DBDRS; 
Pelham, Gnagy, Greenslade, & Milich, 1992) is a teacher 
rating scale that aids in classifying clinical disorders based 
on the 36 diagnostic criteria from the three disruptive 
behavior categories (Attention Deficit Hyperactive Dis¬ 
order, Oppositional-Defiant Disorder, Conduct Disorder) 
described in the DSM-III-R (American Psychiatric Associ¬ 
ation, 1987). The scale is comprised of three factors: 
oppositional/defiant, inattention, and impulsivity/overactiv- 
ity, with respective coefficient a’s of .96, .95, and .95 
(Pelham et al., 1992). Research with this scale has typically 
focused on males in regular and special education 
classrooms (Pelham, Evans, Gnagy, & Greenslade, 1992) 
and demonstrates adequate score stability and validity. 


Home socioemotional behavior 

The Adjustment Scales for Children and Adolescents-Home 
Edition (ASCA-H; Watkins & McDermott, 2002) is a 
behaviorally based parent rating scale containing 202 items 
in 34 situations. Similar to ASCA, it presents behaviors in a 
situational context, but the items are related to behaviors 
observable in the home. Situational contexts include 
parental correction, relationship with other adults, peers, 
care of belongings, chores, meal times, unorganized 
activities, homework, and so forth. The parent indicates a 
child’s behavior by marking any behavioral description 
applied to a situation that they have observed over the past 
two months. 

Although the ASCA-H is still in development, 
preliminary evidence of its structural validity and reliability 
has been provided by two pilot studies. The first study was 
conducted with a sample of 314 children aged 5 to 17 years 
from the mid-Atlantic region of the United States. Three 
replicable factors (Unsocialized, Avoidant, and Restless- 
Impulsive) were found that demonstrated internal consist¬ 
ency (r = .85, .79, and .84) and stability across a 4-week 
interval (r = .65, .74, and .86) as well as convergent and 
divergent validity with other parent rating scales (Mordell, 
2001). The second pilot study was conducted with 426 
children aged 5 to 14 years in the mid-Atlantic region of the 
United States. Four first-order factors (Aggressive-Opposi¬ 
tional, Attention-Seeking Impulsive, Detached, and Diffi¬ 
dent) with internal consistency reliability coefficients 
ranging from .65 to .92 emerged (Coffey, 2006). Internal 
consistency reliability coefficients of the three factors 
(ADH, Conduct Problems, and Overactivity) derived from 
the Trinidad and Tobago sample were .82, .77, and .74 
respectively. 

Academic achievement 

Oral Reading Fluency (ORF; Fuchs, Fuchs, Hosp, & 
Jenkins, 2001) is a curriculum-based academic measure that 
assesses reading fluency by way of the number of words a 
child can read correctly in one minute. Two ORF passages 
that ranged from 153 to 321 words in length were created for 
each grade from local grade-level reading texts. The ORF 
score for each participant was the average of the number of 
words read correctly on those two grade-appropriate 
passages. Typically, the growth curve for fluency is steeper 
in the primary grades and negatively accelerates thereafter 
(Fuchs et al., 2001). That pattern was repeated in this 
sample: There was an average increase in ORF scores of 
43% for each of the first two years assessed and an average 
increase of 12% for each of the final two years assessed. 
Correlations between ORF and other curriculum-based 
measures usually indicate that it performs appropriately, 
with much of recent research focused on predictive validity 
and clinical utility (Reschly, Busch, Betts, Deno, & Long, 
2009). For the current sample, ORF scores correlated .45 
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with a measure of phonological awareness (Watkins & 
Edwards, 2004) among kindergarten-equivalent students 
and .73 with a cloze comprehension measure (Deno, Mirkin, 
& Chiang, 1982; McKenna & Layton, 1990) among 
students in standard 1 and standard 2 grades. 

Procedure 

A list of all government and assisted elementary schools— 
but excluding special schools—was used to identify a 
representative sample of students from 79 elementary 
schools in Trinidad and Tobago, stratified by the regional 
enrollment of the school-aged population. Thus, St. George 
West, with the largest school enrollment, was represented in 
the sample by 19 schools, whereas the Nariva/Mayaro 
region was represented in the sample by 3 schools. One 
classroom at each grade level at each school site was 
randomly selected to participate, and two students (one 
male and one female) were randomly selected from each 
identified classroom. All 700 students from the national 
normative sample were used for scale calibration and the 
validity oversample of 200 students was used to supplement 
structural and validity analyses. In total, 524 teachers at 75 
schools completed ASCA forms. 

Data were collected over one academic year by 
Guidance and Special Education Officers (GSEOs) from 
the Ministry of Education as part of a project between a 
consulting team based at Pennsylvania State University and 
the Ministry of Education (Watkins et ah, 2014). All 
Trinidad officers possessed a university degree and received 
training from the consulting team, and most were assigned 
to gather data in the educational division in which they 
already worked. GSEOs were paid an honorarium for each 
school for which they gathered complete data, and teachers 
and parents also received an honorarium for completing the 
rating scales. 

As ASCA includes positive behavior items even though 
its central focus is behavioral problems, 29 positive 
behavior items were identified and excluded from 
subsequent analysis, reducing the number of items in the 
analysis from 156 to 127. This process also averted the 
likelihood of difficulty, valence, and bipolar factors that 
would tend to emerge in the presence of disparately 
distributed dichotomous items (Bernstein & Teng, 1989). 

Exploratory analysis 

The full sample was randomly partitioned into an 
exploratory subsample (n = 500) and confirmatory sub¬ 
sample (n = 400). The EFA subsample was 50.4% female 
and 49.6% male, with 40.61% of African descent, 36.9% 
East Indian descent, and 22.4% mixed descent. Demo¬ 
graphic characteristics of the CFA subsample were similar 
with 48.8% female, 51.3% male, 39.1% African, 40.1% East 
Indian, and 20.8% Mixed. MicroFACT (Waller, 2001) 


software was used to generate a smoothed tetrachoric 
correlation matrix, applying two-stage maximum-likelihood 
estimation (Olsson, 1979) and least-squares approximation 
of the original matrix (Knol & Berger, 1991). The matrix of 
127 problem behavior items was smoothed for positive 
semidefiniteness. Due to the large number of items and their 
dichotomous nature and expected extreme positive skews, it 
was not feasible to produce a nonsingular matrix; thus, 
iterated components analysis was applied as recommended 
by Debelak and Tran (2013). Specifically, structures 
produced by components analysis with large numbers of 
items will tend to approximate those produced in common 
factoring (Snook & Gorsuch, 1989) and correlation matrices 
for components analysis need not be nonsingular. Minimum 
average partialing (MAP; Velicer, 1976) was used with the 
smoothed matrix to suggest the maximum number of 
retained components. Adhering to the recommendation by 
Snook and Gorsuch (1989) for scales with 50 or more items, 
principal components solutions were rotated toward simple 
structure via varimax, equamax, and promax criteria. 
Solution criteria included: (a) approximate simple structure 
as reflected by a maximized hyperplane count (Yates, 1987) 
and item coverage, (b) at least four salient items per 
component with loadings > .40 defined as salient, (c) 
reliable components (i.e., a > .70), and (d) a theoretically 
sensible structure with parsimonious coverage of the data 
and concordance with leading area research (Fabrigar, 
Wegener, MacCallum, & Strahan, 1999). 

Confirmatory analysis 

It was anticipated that confirmatory factor analysis (CFA) 
involving a very large number of items would make it 
difficult, if not impossible, to successfully apply structural 
equations modeling (SEM) with item-level data. Parameters 
would need to be estimated simultaneously for a large 
number of highly skewed binary items, exceeding the 
capacity of current SEM estimation procedures 
(McDermott, Watkins, Rovine, & Rikoon, 2013). Addition¬ 
ally, the many small cross-loadings would degrade model fit 
and inflate factor intercorrelations (Hsu, Skidmore, Li, & 
Thompson, 2014). Researchers have noted the difficulty that 
SEM faces when attempting to minimize the discrepancies 
between the observed and predicted covariance matrix, the 
low reliability of correlations, correlated errors, and binary 
and highly-skewed item data (Hall, Snell, & Foust, 1999; 
Hau & Marsh, 2004; Kishton & Widaman, 1994; Nasser & 
Wisenbaker, 2003). 

Alternatively, researchers have recommended the 
creation of item parcels (Bandalos, 2002; Hall et al., 
1999; Sass & Smith, 2006; Thompson & Melancon, 1996; 
Wilkinson, 2007). A few items were assigned to each parcel 
and the parcels analyzed in CFA. Problem behavior data 
focuses on rare behaviors and these item data are inherently 
positively skewed and leptokurtic. The distributional 
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balance parceling method is advantageous in this situation 
and results in more normally distributed variables 
(Bandalos, 2002; Hau & Marsh, 2004; Nasser & 
Wisenbaker, 2003; Thompson & Melancon, 1996). 
Unsuitable item parcels can confound sources of error 
variance and result in misspecification of CFA models 
(Bandalos, 2002), whereas properly applied item parcels 
serve to increase the likelihood of normal distributions and 
reduce sampling error (Wilkinson, 2007) and enable 
otherwise infeasible estimation processes. Accordingly, 
each parcel contained items with high prevalences, items 
with moderate prevalences, and items with lower pre¬ 
valences. Parcels based on the salient items from the 
exploratory components analytic solution were submitted to 
maximum-likelihood estimation under the Satorra-Bentler 
scaled difference chi-square for nonnormal data (Satorra & 
Bentler, 2001), with acceptable fit indicated by a Root Mean 
Squared Error of Approximation (RMSEA) < .08 and 
Comparative Fit Index (CFI) > .90 (Marsh, Liem, Martin, 
Morin, & Nagengast, 2011). 


Scaling 

The items associated with each respective dimension were 
scaled through multiple-group IRT, applying the one- and 
two-parameter logistic models based on the national 
normative sample (N = 700). The national normative 
sample was used for calibration purposes in order to yield 
representative parameters. Parameters were thereafter used 
to generate scores for the validation oversample (n = 200). 
Scores were estimated using the Bayesian Expected a 
Posteriori (EAP) method, with the population mean and 
standard deviation for the normative sample centered at 
M = 50, SI) =10. Reliability was assessed for those marker 
items comprising each dimension using Cronbach’s alpha 
coefficient. Reliability was further examined through 
overplots displaying the distribution of test information 
(i.e., the inverse of measurement error) and measurement 
error for each derived ASCA scale. 


External validity 

Product-moment correlations were assessed to determine 
the direction and magnitude of relations between scores on 
each ASCA dimension and external criterion variables. 
Because the data were nested within teachers, following the 
recommendations by Waterman, McDermott, Fantuzzo, and 
Gadsden (2012), relationships were also estimated using 
hierarchical linear modeling (HLM), where each ASCA 
dimension served as the group-mean centered predictor in a 
two-level conditional model, indicating the percentage of 
between-children within-teacher variance accounted for by 
respective ASCA dimension scores. 


RESULTS 

Dimensionality 

MAP for 127 problem behavior items suggested that up to 
8 components might be extracted from the smoothed 
tetrachoric matrix. The 1- through 8-component models 
were tested against the stated criteria. The 2-component, 
promax-rotated (k = 3) model emerged as the optimal 
solution, where Waller’s (2001) Goodness-of-Fit 
Index = .88 and the Root Mean Squared Residual = .09. 
Models extracting more than two components contained 
underidentified and unreliable dimensions and the 1- 
component model compressed the 2-component model 
into an uninterpretable composite dimension. Per Comrey’s 
(1988) recommendations, 5 items providing multiple salient 
loadings (thus refining simple structure and reducing 
interfactor correlations) and 16 items yielding item-total 
scale correlations < .20 (thus suppressing internal 
consistency and discrimination) were excluded from further 
analysis. The remaining 69 items were retained. Table 1 
presents rotated pattern loadings, final communalities, item- 
scale correlations, and prevalence (in the national normative 
sample). Coefficient alpha for each scale is also posted (see 
the centered headings). Based on item content and patterns 
of descending loadings, the scales were named Overactivity 
(50 items; M behavioral prevalence = 9.4%) and Under¬ 
activity (19 items; M prevalence = 7.0%). Underactivity 
corresponds to internalizing problems and Overactivity to 
externalizing problems, as previously discussed. There was 
a weak correlation between Overactivity and Underactivity 
scores, r = .13, p < .001. 

The two-dimensional structure was replicated for the 
confirmatory subsample, as represented by 15 quadruple 
and 3 triplet item parcels. Model fit was adequate, where 
Satorra-Bentler X 2 (134) = 234.13, CFI =.912, and 
RMSEA = .043 (90% Cl = .034/.052). 

Scaling and Reliability 

The log-likelihood deviance test indicated that the two- 
parameter logistic was a superior fit to the one-parameter 
logistic model {p < .0001) for each scale. For Overactivity, 
the threshold parameters ranged 0.75- 3.23 (M = 1.93, 
SD = 0.54), slopes ranged 0.46- 2.68 (M = 1.22, 
SD = 0.42), average information = 11.36, and the approxi¬ 
mate maximum information = 51.54 at 0 = 1.75, while for 
Underactivity the thresholds ranged from 1.61 to 3.21 
(M = 2.27, SD = .42), slopes from 0.70 to 1.38 (M = 1.02, 
SD = 0.23), average information = 2.67, and maximum 
information = 13.17 at 6= 2.25. 

EAP (Thissen, Pommerich, Billeaud, & Williams, 1995) 
scaled scores (SSs) were estimated for members of the 
normative sample. Based on normative SSs and measure¬ 
ment error, the IRT reliability index for Overactivity was .92 
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TABLE 1 

Dimensional Structure and Properties of the Adjustment Scales for Children and Adolescents 


Item description 0 



Scale pattern loadings b 


/ 

II 

Communality 

Item/scale r c 

%Prevalence d 


Scale I: Overactivity (coefficient a : 

= .92") 



Disrupts team games by fooling around 

.84 

-.09 

.66 

.63 

6.7 

Does things in front of teacher 

.78 

-.10 

.57 

.57 

9.1 

Much too talkative with teacher 

.76 

-.25 

.52 

.53 

13.4 

Often cause of trouble in line 

.75 

.03 

.59 

.58 

4.9 

Talks, gazes, plays during schoolwork 

.72 

-.07 

.49 

.57 

26.6 

Disturbs others’ fun at play 

.72 

.01 

.52 

.51 

4.9 

Snatches objects away from others 

.71 

-.04 

.49 

.51 

5.4 

Constantly restless, shifts, raps 

.70 

-.17 

.44 

.51 

20.4 

Wants to dominate and have own way at play 

.69 

-.19 

.43 

.50 

13.0 

Attacks others viciously if provoked 

.69 

.02 

.49 

.53 

5.0 

Doesn’t stay in seat when should 

.66 

-.19 

.39 

.45 

15.3 

Poor loser, causes disturbances 

.66 

-.04 

.42 

.48 

6.1 

Quarrels, provokes others 

.66 

.00 

.44 

.51 

6.7 

Takes things from desks or lockers 

.64 

.02 

.42 

.48 

8.9 

Makes sexually offensive gestures/remarks 

.64 

.05 

.43 

.42 

3.1 

Associates with troublesome youth 

.63 

.00 

.40 

.52 

7.3 

Misbehaves when teacher attends others 

.62 

-.18 

.34 

.45 

30.1 

Answers before taking time to think 

.61 

-.28 

.35 

.38 

20.3 

Tries to dominate agemates 

.61 

-.07 

.35 

.44 

8.7 

Loses temper if can’t get way 

.60 

-.06 

.34 

.43 

9.3 

Uses devices to gain teacher’s attention 

.59 

-.16 

.31 

.40 

13.7 

Starts fights and rough play 

.59 

.18 

.45 

.44 

3.9 

Uses bad language that offends others 

.59 

.00 

.35 

.43 

6.4 

Doesn’t hesitate to lie 

.58 

.17 

.43 

.39 

3.4 

Overly rough with smaller or weaker children 

.58 

.12 

.40 

.43 

5.7 

Helps teach unless in a bad mood 

.57 

.02 

.33 

.37 

5.0 

Clowns around, plays silly tricks 

.57 

-.14 

.30 

.40 

8.4 

Pushes in front of others in line 

.57 

-.16 

.30 

.41 

14.9 

Occasionally lies to avoid blame 

.56 

-.07 

.29 

.42 

24.9 

Takes correction badly, muttering 

.54 

.07 

.31 

.43 

11.9 

Destroys or defaces own books, etc. 

.54 

.10 

.34 

.45 

10.7 

Has stolen from other pupils 

.54 

.18 

.38 

.38 

3.3 

Deliberately destroyed others’ belongings 

.53 

.18 

.37 

.33 

2.4 

Plays around when working with hands 

.52 

-.07 

.25 

.36 

16.6 

Made unprovoked attacks on other students 

.52 

.07 

.30 

.35 

4.9 

Inclined to cheat at play 

.50 

.05 

.27 

.35 

6.9 

Only works when watched 

.49 

.18 

.32 

.37 

6.6 

Tells tall tales about self/family 

.47 

.03 

.23 

.28 

4.6 

Answers aggressively to corrections 

.47 

.23 

.34 

.29 

1.6 

Throws or sweeps objects with no reason 

.47 

.16 

.29 

.29 

3.9 

Sometimes unfriendly to teacher 

.46 

.14 

.27 

.34 

5.7 

Charges in new learning tasks without thinking 

.46 

-.09 

.20 

.33 

14.3 

Asks for jobs but doesn’t finish 

.45 

.17 

.28 

.33 

6.3 

Unusual sitting positions, climbs on desk 

.45 

.20 

.29 

.26 

3.1 

Unkind to weaker children 

.43 

.32 

.37 

.31 

2.9 

Improves after correction, doesn’t last 

.42 

.07 

.20 

.37 

23.9 

Makes sudden inappropriate noises 

.42 

-.05 

.17 

.28 

5.6 

Rushes around shouting madly 

.42 

.31 

.35 

.25 

1.4 

Welcomes teacher loudly 

.41 

-.25 

.17 

.22 

19.3 

Can’t keep a friend for long 

.41 

.20 

.26 

.26 

2.0 


Scale II: Underactivity (coefficient a 

= ,74 e ) 



Sits so quietly don’t know if attending you 

-.38 

.66 

.42 

.45 

11.1 

Too unenergetic to be troublesome 

.00 

.63 

.39 

.23 

1.3 

Sits meekly, seems afraid to budge 

-.35 

.63 

.38 

.42 

8.3 

Too withdrawn to help teacher 

-.32 

.62 

.36 

.27 

4.0 


(i continued ) 
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TABLE 1 — (Continued) 


Item description' a 



Scale pattern loadings b 


/ 

II 

Communality 

Item/scale r c 

%Prevalence d 

Too timid to join in unorganized play 

-.34 

.60 

.35 

.36 

5.7 

Has a dejected look generally 

.17 

.54 

.38 

.34 

3.0 

Freezes up and doesn’t answer questions 

-.13 

.52 

.25 

.28 

5.4 

Seems afraid to try work with hands 

-.15 

.52 

.25 

.25 

4.9 

Sits lifelessly most of time (at desk) 

-.04 

.50 

.24 

.31 

5.1 

Does not stand up for self 

-.18 

.49 

.21 

.30 

10.4 

Needs encouragement to join team games 

-.27 

.49 

.23 

.30 

15.7 

Rarely smiles 

-.04 

.47 

.21 

.27 

4.3 

Tends to have untalkative moods 

-.06 

.45 

.19 

.30 

9.6 

Not shy but rarely offers answer 

.02 

.44 

.20 

.32 

10.3 

Won’t attempt if senses difficult new learning 

.20 

.43 

.28 

.39 

9.6 

Waits for teacher to greet first 

-.13 

.43 

.17 

.24 

7.7 

Distant, makes no relationship with teacher. 

.24 

.42 

.29 

.24 

3.9 

Slow and doesn’t finish handwork 

.10 

.42 

.21 

.35 

10.7 

Used as scapegoat, object of ridicule 

.10 

.41 

.20 

.21 

2.7 


a Descriptions incorporate item content and relevant situational contexts. Item content and contexts are abbreviated for convenient presentation. 

b Values are promaxian pattern loadings at k = 3, where hyperplane count is maximized. Salient pattern loadings (a .40) are italicized. N = 500 
comprising the random exploratory analysis subsample. 

c Each correlation reflects the relationship between an item and the sum of the other items composing a given scale, where item distributions were 
standardized to unit-normal form. 

d Entries indicate the percentage of children for whom the item behavior is scored present. Values are based on the normative calibration sample (N = 700), 
including the exploratory and confirmatory analyses subsamples. 

“Reliability is based on the exploratory subsample (N = 500). 


and for Underactivity was .73. Figure 1 illustrates for each 
dimension the overlap of total test information and 
measurement error. It is evident that SSs will have practical 
utility from ~ 2/3 SD below the population mean and 
throughout the highest SSs. This is particularly useful 
inasmuch as ASCA SSs are often used to discriminate 
between behavior that is adequately adjusted (< 60), versus 
at risk (> 60 and < 70) versus maladjusted (> 70). 
Overactivity and Underactivity scores were reliable (i.e., 
a > .70) with coefficient a for Overactivity = .92 and 
Underactivity = .74. Coefficient a was based on the 
exploratory subsample (n = 500) for each scale. 


External Validity 

Table 2 displays concurrent relations between ASCA 
scores and independent criterion measures. All statistically 
significant correlations are in the expected direction with 
ASCA scores evincing moderate to strong relations with 
other teacher rating measures and anticipated lower 
relations with a parent rating measure and a direct 
assessment of reading achievement (Dinnebeil et al., 
2013; Hartley, Zakriski, & Wright, 2011; van der Ende 
et al., 2012). Due to the nested nature of the data, the last 
column in the table lists the percentage of criterion 



FIGURE 1 Distributions of estimated information functions and standard errors for ASCA scales. 
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TABLE 2 

Relationships Between ASCA Scores and Concurrent Criterion Measures 


ASCA scale a 


Criterion measure 


Overactivity 


Underactivity 


% Explainable variance b 


Inattention (n = 673) 
Oppositional/Defiant (n = 630) 
Impulsivity/Overactivity (n = 631) 


Disruptive Behavior Disorder Rating Scale (teacher rating) 
.55 (54.0) .33 (27.1) 

.60 (59.7) .13 (6.3) 

.65 (60.0) - ,02 f (12.3) 


Fall Mean of A & B passages (n = 678) 
Winter Mean of A & B passages (n = 709) 
Spring Mean of A & B passages (n = 678) 


Oral Reading Fluency (direct assessment) 

- .26 (5.4) - .20 (5.9) 

- .25 (8.3) - .24 (6.0) 

- .26 (5.4) - .20 (5.9) 


Total score (n = 755) 

Competence motivation (n = 815) 
Attitude (n = 811) 

Persistence (n = 818) 

Strategy (n = 797) 


Learning Behaviors Scale (teacher rating) 


-.52 (38.5) 
-.37 (17.2) 
- .43 (20.8) 
-.54 (33.3) 
-.55 (38.5) 


- .44 (34.8) 

- .50 (35.0) 
-.48 (50.1) 
-.34(19.2) 
-.17 (32.2) 


Attention-Deficit Hyperactivity (n 
Conduct Problems (n = 719) 
Underactivity (« = 719) 


Adjustment Scales for Children and Adolescents- 
: 720) .25 (6.8) 

.25 (7.1) 

- .03* (1.9) 


-Home Edition (parent rating) 
-.01 f (12.5) 

.12 ( 11 . 2 ) 

.10(5.8) 


84.8 

90.9 
80.0 


60.5 

59.1 

60.5 


83.7 

98.7 

87.7 
92.0 
72.3 


88.7 

97.9 

84.9 


a Nonparenthetical entries are Pearson product moment correlations. Parenthetical entries indicate the percentage of variance in the respective criterion 
measure scores between children within classrooms that is accounted for by a given ASCA scale score. Values equal the proportional reduction in the residual 
variance (100) as estimated via hierarchical linear modeling. Each two-level random coefficients model entered a given ASCA scale as the covariate. All 
correlations and fixed effects associated with ASCA scales are significant statistically at p < .01 unless indicated t (nonsignificant). ASCA = Adjustment 
Scales for Children and Adolescents. 

b Total percentage of potentially explainable variance between children within classrooms. Values equal 1 - intraclass correlation (100), where the 
intraclass correlation was estimated via hierarchical linear modeling. Each two-level, unconditional means model applied random intercepts for classrooms, 
where the random effect was significant at p < .001. 


measure variance that reflects children’s actual individual 
differences and parenthetical values indicate how much of 
that variance is accounted for by a given ASCA scale. For 
example. Table 2’s last column entry for the DBDRS 
Inattention scale indicates that, whereas 84.8% of score 
variance stems from children’s individual differences 
(rather than teacher characteristics), 54.0% of that 
variance is predictable from children’s ASCA Over¬ 
activity scores and 27.1% predictable from ASCA 
Underactivity scores. Teachers seem to be more sensitive 
to reporting overactivity-type problems. ASCA Over¬ 
activity and Underactivity scores are similarly effective in 
accounting for individual differences in reading 
performance. 


Demographic Trends 

Table 3 displays the mean population distribution of 
Overactivity and Underactivity by gender and grade level in 
Trinidad and Tobago, while Table 4 shows the distribution 
by gender and ethnicity. There appears to have been no 
peaking or appreciable shifts in variance on either 
dimension for these characteristics. 


DISCUSSION 

This study sought to establish representative national norms 
and examine the psychometric properties for ASCA in 
Trinidad and Tobago. There has been extensive work on the 
normative development, dimensionality, and validity of 
ASCA for application in the United States (Canivez, 2004; 
Canivez & Bordenkircher, 2002; Canivez & Rains, 2002; 
Canivez & Sprouls, 2005; McDermott, 1993; McDermott 
et al., 2005), but little empirical evaluation regarding its use 
in international populations. This analysis of the properties 
of ASCA with a population from Trinidad and Tobago 
expands the literature on cross-cultural applications of 
ASCA, possibly laying the foundation for large-scale 
multicultural comparisons similar to those based on parent 
reports (Ivanova et al., 2010; Rescorla et al., 2007; Rescorla 
et al., 2011). 

A nationally representative sampling of the distribution 
of behavior problems in Trinidad and Tobago uncovered 
two broad dimensions of childhood problem behavior, 
Overactivity and Underactivity, through exploratory and 
confirmatory analyses. The resulting dimensional structure 
of Overactivity and Underactivity differed from the 
hierarchical structure derived in the United States 
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TABLE 3 

Mean Population Distribution of Overactivity and Underactivity by 
Gender and Grade Level in Trinidad and Tobago 





Overactivity 

Underactivity 

Gender 



M 

(SD) 

M 

(SD) 

Male 

(«= 

50) 

Infant 1 

51.0 

(8.7) 

49.9 

(7.4) 

Female 

(n = 

50) 

51.7 

(9.0) 

51.1 

(8.3) 

Male 

(n = 

50) 

Infant 2 

52.1 

(10.1) 

50.2 

(8.2) 

Female 

( n = 

50) 

49.0 

(8.1) 

51.4 

(8.8) 

Male 

(n = 

50) 

Standard 1 

52.5 

(9.9) 

50.5 

(8.7) 

Female 

(n = 

50) 

49.3 

(8.7) 

49.2 

(8.1) 

Male 

(« = 

50) 

Standard 2 

51.0 

(8.4) 

49.0 

(7.5) 

Female 

(n = 

50) 

46.4 

(8.1) 

49.5 

(7.7) 

Male 

(n = 

50) 

Standard 3 

51.5 

(9.7) 

50.9 

(8.4) 

Female 

(n = 

50) 

48.7 

(9.0) 

50.0 

(8.2) 

Male 

C n = 

50) 

Standard 4 

48.8 

(8.8) 

49.5 

(7.6) 

Female 

C n = 

50) 

46.1 

(8.0) 

48.6 

(6.8) 

Male 

(n = 

50) 

Standard 5 

53.0 

(10.7) 

50.2 

(6.7) 

Female 

(n = 

50) 

48.9 

(8.5) 

50.1 

(8.2) 

Male 

(« = 

350) 

Total 

51.4 

(9.5) 

50.0 

(7.8) 

Female 

(n = 

350) 

48.6 

(8.6) 

50.0 

(8.0) 


standardization that presented the same externalizing and 
internalizing dimensions, but with additional underlying 
dimensions of specific syndromes (McDermott, 1993). 
However, the Overactivity and Underactivity dimensional 
structure has been found in other populations including 
Hispanic/Latino, Native American, and Canadian youth 
(Canivez & Beran, 2009; Canivez & Bohan, 2006; Canivez, 
2006; Canivez & Sprouls, 2010). 

TABLE 4 

Mean Population Distribution of Overactivity and Underactivity by 
Gender and Ethnicity in Trinidad and Tobago 


Overactivity Underactivity 


Gender 



M 

(SD) 

M 

(SD) 




African descent 



Male 

(n = 

137) 

53.5 

(9.7) 

49.1 

(7.5) 

Female 

(n = 

132) 

49.8 

(9.4) 

49.8 

(8.0) 




East Indian descent 



Male 

C n = 

126) 

49.4 

(9.0) 

50.4 

(7.8) 

Female 

(n = 

131) 

46.8 

(7.3) 

50.0 

(7.9) 




Mixed descent 



Male 

(» = 

76) 

51.3 

(9.1) 

51.4 

(8.4) 

Female 

(» = 

73) 

49.2 

(8.3) 

49.7 

(7.6) 




Total 




Male 

(n = 

350) 

51.4 

(9.5) 

50.0 

(7.8) 

Female 

(n = 

350) 

48.6 

(8.6) 

50.0 

(8.0) 


Emergence of the Overactivity and Underactivity factors 
provides further evidence on the cross-cultural universality 
of these two broadband problem behavior dimensions 
(Eysenck, 1953; Kohn, 1977; Peterson, 1961; Rutter, 1967). 
Our Underactivity dimension, similar to internalizing, is 
associated by problems with negative emotion (Markon, 
2010) whereas Overactivity, similar to externalizing, is 
characterized by disinhibition problems. The two-dimen¬ 
sional finding in Trinidad and Tobago bolsters the 
robustness of the two-dimensional IE model, a model that 
has remained consistent across age, sex, ethnicity, culture, 
informant type, instrument, and DSM Axes (Achenbach, 
1966; Eaton et ah, 2011; Forbush & Watson, 2013; Kramer 
et ah, 2008; Krueger et al., 1998; Krueger et ah, 2003; Lahey 
et ah, 2008; Slade & Watson, 2006; Wright et ah, 2013). 

Validity analyses indicated ASCA scores have moderate 
to strong relationships with other teacher rating measures 
and weaker relationships with a parent rating measure and 
reading achievement. Additionally, teachers seem to be more 
sensitive to overactive- than underactive-type problems. 
Overactivity and Underactivity scores accounted for similar 
levels of actual individual differences in reading fluency. The 
lower relationships between parent and teacher ratings were 
anticipated based on past discoveries of behavior rating 
differences among teachers and parents (Achenbach, 
McConaughy, & Howell, 1987). Informant discrepancies 
may be explained partially by cross-contextual variability in 
children’s behavior, differences in the environments in 
which child behavior is observed, and informants’ differing 
perspectives and tolerance for child behavior (De Los Reyes, 
Thomas, Goodman, & Kundey, 2013). 

The islands’ normative sample included only elementary 
school students, limiting the age range for comparisons 
between Trinidad and Tobago and the United States, which 
included secondary school children. Validity analyses of 
academic achievement were also constrained to a reading 
fluency measure because no other academic assessments 
were available. Further, this was a curriculum-based 
measure, as there are currently no mandated standardized 
achievement assessments in Trinidad and Tobago. Each 
student was rated by one teacher only, which precluded us 
from calculating interrater reliability. However, prior 
research in the U.S. found good agreement between 
teachers (r > .80) on the two broad ASCA classifications 
(Canivez & Watkins, 2002; Schaefer et al., 2001; Watkins & 
Canivez, 1997). Additionally, dependence on item-level 
binary data puts limits on standard estimation procedures 
(convergence problems, necessity for item parcels, etc.). 
One alternative we are exploring is item reduction by 
conducting context-level instead of item-level analysis, as 
per McDermott, Watkins, Rovine, and Rikoon (2014). 

Given the popular ethnographic research conclusion that 
Trinidadian parents evince a distinct penchant for child 
rearing centered on order and discipline (Barrow, 2008; 
Cappa & Khan, 2011; Gopaul-McNicol, 1993, 1999), we 
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thought it important to contrast ASCA empirical trends in 
Trinidad and Tobago with those reported for the American 
standardization sample (McDermott, 1993, 1994). It has been 
hypothesized that a cultural standard more sensitive to 
indiscipline would likely generate higher levels of observed 
overactive behavior and show a greater tolerance and lower 
levels for underactive (albeit compliant) behavior (Roop- 
narine et al., 2014). Accordingly, the average prevalence for 
Overactivity problems in Trinidad and Tobago was 9.4%, 
whereas in the United States prevalence was only 6.7%. 
In turn, average prevalence for Underactivity behaviors in the 
islands was 7.0%, whereas in the United States it was 7.5%, 
thus lending empirical support to the ethnographic hypothesis. 

Additional contrast is provided in ancillary analyses 
applying the U.S. national scoring parameters to the 
Trinidad and Tobago normative sample. Here, the U.S. 
Overactivity and Underactivity SS means were 51.5 and 
49.7, respectively, for the same age group as the Trinidad 
and Tobago normative sample, with the corresponding 
means for the islands being 53.7 and 49.0, respectively, 
again lending support to the ethnographic viewpoint. 

CONCLUSION 

The standardization and validation of ASCA marks a major 
step in the establishment of culturally relevant standards for 
behavioral assessment in Trinidad and Tobago. In 1997, the 
Ministry of Education’s Central Guidance and Special 
Education Units began the Continuous Assessment Progress 
project and set the goal of identifying low-performing 
students and providing them with supportive services 
(Watkins et al., 2014). The ministry later merged the 
Guidance and Special Education Units into the Student 
Support Services Unit while keeping the focus on 
preventative services. Though the Ministry of Education 
has conveyed interest in using assessment data to offer 
targeted services to students and to improve school 
performance, more development needs to be done. However, 
Trinidad and Tobago has invested far more in assessments 
and data collection than many other developing countries 
(Hu & Oakland, 1991 ; Oakland, 2004; Oakland & Hu, 1993; 
Oakland et al., 2013) and the information is ready and 
available for identifying at-risk students. The standardization 
and validation of ASCA in Trinidad and Tobago has created a 
bridge that can be used for intervention with struggling 
students. With proper interventions and supportive services, 
needy students are more likely to reach their full academic 
potential and become productive members of society. 
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